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iS7) Abstract 

A tyttem and preceu for composing s musical section in response to a user's interaction with a multimedia psesenution is diKlosed. 
The system includes a composition enjine (14). perfonnance engine (16). and art)itretor (12). The aibitrator provides an interface with an 
application program twming a multimedia presentation. TTie arbitrator receives parameteis from the application program indicative of a 
user's iniencticai and the type of music the application program requests in response to the interaction. The parameters are passed to the 
composition engine (14) which composes a musical section having a chord progression and other date therein. The musical section and a 
style provided b>- the arbitraior are used by the performance engine (16) to generate music se<|uence data for driving a musical instrument. 
The performance of the musical letjuence data by the musical insmuneni occurs substantially coniemporgncously with the user's interaction 
which caused the musical section composition. Because the composition engine (14) uses processes which varv the composition of musical 
secUons. the user events which initiate composiUon of a musical section and which occur at the same place within a multimedia presenution 
still vary the performance at «ach user event. 
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System for Enhancing a Multimedia Presentation by Composing Music According to 
a User's Perception 



FIELD OF TIH E nWWNTlinw 

This invention relates to computer generated music, and mope 
particularly, to computer generated music which enhances a user's inieracUon with a 
computer program. 

BACKfiwnimm oy y |n^|»j^^^ 

Multimedia computer programs are spreading throughout the -computer 
industry. Multimedia programs are viewed as immersing a user in an environmem 
thai stimulates learning and enhances entertainment. Such a program does this by 
presenting data to a user through both audio and video and requites the user to interact 
with the program through a keyboard, joystick, or the like. An imponant-componem 
to this multimedia presentation is the music sometimes perfonned during a 
presentation. Although the music is most often not a dominant part of the 
presentation, a user viewing visually presented data does hear the accompanying 
1 5 musical performance. As a consequence, the user may associate elements of the video 
performance with the audio performance. This association may facilitate learning of 
an important concept or make interaction with a program, such as a videO:game, more 
enjoyable. 

Previously, the music performed during a multimedia presentation is 
20 prerecorded, usually in a digital format. The music is typically commenced by the 
program controlling the multimedia presentation much as a jukebox lesponds to the 
selection of a song for a perfonnance. In other words, the same song or musical 
recording is retneved and performed in response to the same event each time. The 
more that a user interacts with the multimedia presentation, the more the^er hears 
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ihe music. After a number of times, the user may tire of the same musical 
accompaniment and consider it monotonous or even irritating. As a consequence, the 
music becomes Jess useful in stimulating the user and enhancing the multimedia 
presentation. 

5 Another problem with t>pical multimedia presentations is sudden 

musical transitions. Typically, each scene of a multimedia presentation has a 
particular piece of prerecorded music associated with it. When that scene 
commences, the musical performance begins as discussed above. If a user decides to 
transition to an auxiliary presentation, such as an associated lesson, or performs an 
10 action which terminates the presenuition, such as "killing" the enemy in a video game, 
the application program transitions to a new scene. Typically, the multimedia musical 
perfoimance simply terminates the currently playing musical sequence and initiates 
the prerecorded music for the new section. There may be no musical relationship 
between the music associated with the first and second scenes and the transition may 
1 5 appear to be disjointed and disrupt the user's interaction as a result. 

One attempt to deal with the musical transition problem is disclosed in 
U.S. Patent No. 5.315,057 to Land, et al. That patent teaches a method of providing a 
number of predetermined decision poims at which an evaluation is made to determine 
if a particular evem has occurred. If it has. the program selects a transitional musical 
20 sequence to more musically transition to the next scene and its associated musical 
accompanimem. This approach has a number of drawbacks. First, for each evem 
condition, the transition piece is always the same. Thus, if a person is continually 
encountering the same termination point in a presentation, for example, being unable 
to answer a question in an educational lesson or unable to overcome some obsujcie in 
25 a x ideo game, the user always hears the same piece, which may result in the problems 
previously noted. Second, the cflbn to identify and program the decision points and 
where they should be evaluated during a multimedia presentation is an exuemely 
labor intensive effon. 
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What is needed is a way of providing fresh musical data lo accompan\ 
a multimedia presentation or portions of the presentation each time it is presented. 
What is needed is a way of transitioning from one scene of a multimedia presentation 
to another withoui requiring labor intensive programming of «ach predetermined 
5 decision point. 

SUMMARY OF TWF KNVENTFON 

The above noted problems are sol ved by a musical composition system 
built in accordance with the principles of the present invention. The system includes 

1 0 an application program interface for receiving panuneters that identify the type of 
music which enhances a user's interaction with the multimedia presentation and a 
composition engine for composing a musical section that corresponds to the 
parameters from the application program. The requested music type is identified by a 
style, a shape, and a personality. The composed musical section defines a chord 

15 progression and groove embellishment commands. The section is used by a 

performance engine to perfomi music so that the user perceives the performance of 
the composed musical section to be contemporaneous with the action which initiated 
the composition. 

Because the composition engine may compose a new musical section 
20 in response to events initiated by a user, the music corresponding to ihe composed 
section usually varies for each performance. As a result, the user maintains her 
interest in the educational program or game. Because the parameters do not define the 
musical content for a performance, such as a chord progression or the notes, the 
composition engine is driven without requiring extensive knowledge of music. 
25 Instead, the application program may simply request a musical perfonnace by 

identifying a shape, a style, and a personalit>\ For example, in response to a user's 
action with a multimedia event, the application program may request the performance 
of a "rising, angr\'" piece in a jazz style. 
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When the appiicaiion program provides the composition «ngine with a 
request for a transition to a new musical piece, the composition engine responds with 
a composed transitional section that correlates the music currently being performed to 
the music associated with the new scene. The composition engine is able to compose 
the transitional section and synchronize it with the current musical perfoimance 
virtually anywhere in the ongoing performance. 

The composition engine of the present invention may include a 
template generator which builds a template for describing and defining the musical 
shape of the musical section to be composed. The composition engine uses a template 
and a personality to compose a musical section. A personality is preferably a 
predetermined data structure which contains information to musically defme a 
particular mood. Personalities are identified by terms such as "upbeat." "miserable." 
"wear^ "tense," or "majestic." 

Each personality contains a list of connection chords, an appropriate 
musical scale, a list of important chords for the personality called signpost chords, and 
a chord palene which is a list of chords which "fit" the particular personalit>'. These 
data structures are used to complete the information provided by a template to create 
the musical content for a musical section so it may be later performed. This musical 
information includes a chord progression, groove commands, and embellishment 
commands which are used by the performance engine. 

Once the musical section has been composed, it may be passed to the 
performance engine to generate a music sequence. A music sequence is comprised of 
the insvument commands for a musical device which performs a musical piece. 
Typically, the composed musical section is provided to the performance engine near 
the conclusion of the currenily performed section to maintain musical continuity in 
the performance. Should a uansition be required, however, the transition section is 
provided to the performance engine with a command to end the current music 
performance at an appropriate location, such as the end of a current measure. The 
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perfonnance engine then commences the perfonnance of the newly composed 
transitional section followed by the next musical section. In this way, there is a 
smooth and conUnuous performance of music which transitions from one section to 
another in a pleasing and melodic fashion. 
5 The composition engine may specifjcally compose transitional sections 

in response to parameters received from the application program interface. The 
parameters received include identification of the cuirem and destination musical 
sections, the time when the transition should occur, and a flag indicating whether an 
embellishment is required. The composition engine uses the personality of the 
1 0 destination section and the coments of the current musical section to compose the 
transitional section. This transitional section is then passed to the perfonnance engine 
for generation of a music sequence. 

The composition engine of the present invention also responds to a 
parameter from the application interface to change the personality of a music section. 
15 To change the personality of a section, the composition engine uses the information 
from the selected personality- to change the chords of a musical section. The engine 
may also alter the chords of the musical section to conform to the musical scale or key 
of the new personalit}-. Because a scale change may alter the type of key for a 
musical section, for instance from major to minor, this change may significantly alter 
20 the music corresponding to a musical section. 

The system of the present invention may also include a performance 
engine to generates a music sequence from a musical section and a style. A style is a 
predetermined data su^cture that defmes the note patterns for each instrument voice. 
The perfonnance engine of the inventive system includes the capabilit>' of perfonning 
25 a motif in response to parameters received from an application program. A motif is a 
shon musical pattern that is t>'pically associated u-ith a particular character or event 
presented in a multimedia presentation. The perfonnance engine responds to 
parameters indicating the t>pe of s.vnchronization that should occur, and appropriate!. v 
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synchronizes ihe playing of the moiif section with the cmreni musical section. The 
moiif section also includes a pluraliiy of noie patterns for the motif. The performance 
engine of the present inveniion may select one of the note patterns for the motif and 
transpose the pattern so it correspondsMcS^asmtasij^atesfe^^ 
5 for a multimedia scene. The variations fftftNth?ggyp^ff^^^^ 
composition method and the variations ofiiilhesiiioi^>8^^sn)^^ 
that the motifs differ for each perfomiance. 

Because the system of the present invention is able to compose musical 
and uansitional sections, transpose motifs, and alter the personality of a musical 

1 0 section based upon a user's interaction with a multimedia presentation, it usually 
provides new accompaniment to the scenes of a multimedia presentation for each 
performance of the scenes. Because the application program may request music by 
only identifying a style, shape, and personaH^Jh*«BpjpBUQoiim^^ present 
invention provides a simple method for com{^^lgesh6n^i^p8ssss^ 

1 5 requiring the application programmer to haj^eafknowledgf^ofrmusicv^ These and 
other advantages of features in the present*inventJon^shidl'Becomc^appafeht to the 
reader in view of the accompanying drawinggjan^d^taiiejdsjlesGn 



BRIEF PESCRIPTION OF THE PRAWINtnii; 
20 The present invention may take form in various components and 

arrangement of components and in v arious steps and arrangement of steps. The 
drawings are only for purposes of illustrating a preferred embodiment and processes 
and are not to be construed as limiting the invention. 

25 the present invention; 

Fig. 2 is a block diagram-Gfcthe^eomp©sWoniengiQe*sho.wn^i 1 ; 
Fig. 3 is a flowchart of the preferred process for composing musical 
templates in the composition engine shou-n in Fig. 1 : 
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Fig. 4 shows a prcfemd set of signpost chord markers; 
Fig. S is a flo>vchan of the preferred process lo plac^ signpost chord 
markers in a template used in the musical template generator shown in Fig. 2; 

Fig. 6 is a data structure definition of the embellishment and groove 
5 commands used in the preferred process shown in Fig. 7; 

Fig. 7 is a flowchart of a preferred process to place embellishment and 
groove commands of the type shown in Fig. 6 in a musical template; 

Fig. 8 is a flowchart of a preferred process for calculating the groove 
level commands for a template; 
1 0 Fig. 9 is a data structure definition of a template constructed by the 

processes shown in Figs. 5, 7 and 8; 

Figs. lOA-D are data structures for a personalit>' used by the musical 
section generator of Fig. 2 to compose a musical section; 

Fig. 1 1 is a flowchart of a preferred process which composes a musical 
1 5 section in the composition engine shown in Fig. 1 ; 

Fig. 12 is a data structure definition of a musical section generated by 
the composition engine of Fig. 1 ; 

Fig. 13 is a flowchart of a preferred process for assigning signpost 
chord markers in a template which is pan of the process shown in Fig. 1 1 : 
20 Fig, 14 is a flowchart of a preferred process which builds a chord 

connecting path between two successive signpost chords for the musical section 
generator of Fig. 2: 

Fig. 1 S is a flowchart of a preferred recursive process of musical 
section generator shown in Fig, 2 which traverses a path defined by next chord 
25 pointers to detennine whether a chord connecting path between two successive 
signpost chords satisfies the criteria for a valid chord connecting path; 
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Fig. 16 is a flowchan of a preferred process for music transitional 
section generator of Fig. 2 >^-hich composes a transition section between cun^ni and 
destination music sections; 

Fig. 17 is a flowchart for a preferred process of musical section 
personalit>' converter of Fig. 2 which switches the personality of a music section: 

Fig. 18 is a preferred data format for representing note data in the 
system of Fig. 1; 

Fig. 19 is a flowchart for a preferred process used to synchronize the 
performance of a motif to a music section: and 

Fig. 20 is a flowchart for a preferred process for perfonning a motif bj 
the performance engine shown in Fig. 1 . 
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PETAOXD IDFSrWIPTtON OF Thf ih:vp|v.j„^^ 

A system incorporating the principles of the present invention is shou-n 
1 5 in Fig. 1 . The system 1 0 includes an arbitrator 1 2. a composition engine 1 4, a 
perfonmance engine 16. data storage 18. and an instrumem interface 20. The 
arbitrator 12 preferably receives from an application program which is driving a 
multimedia presentation information or parameters about the shape, style, and 
personalii>' for a requested musical performance. Alternatively, all or a portion of the 
arbitrator 12 may be incorporated in the application program. Based upon the 
information received from the application program, arbitrator 12 may access data 
storage 1 8 to provide musical sections and styles to performance engine 16 for 
generation of a music sequence, or pass parameters to composition engine 14 for the 
composition of a musical section. Additionally, arbitrator 12 receives feedback 
25 regarding the performance of a musical section from performance engine 1 6 and 
provides all or a ponion of thai feedback to the application program. 

Further details of composition engine 14 are shown in Fig. 2. 
Composition engine 14 performs functions or processes to compose musical -sections 
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perfonnance engine then commences the perfonnanc* of<he newly composed 
transiuonal section followed*y the next musical section. In this way, there is a 
smooth and continuous perfoimance of music which transitions from one section to 
another in a pleasing and melodic fashion. 
5 The composition engine may specifically compose ttansitional sections 

in response to parameteis received from the application program interface. The 
parameters received include identification of the current and<iestination musical 
sections, the time when the transition should occur, and a flag indicating whether an 
embellishment is required. TTie composition engine usesihe personality of the 
10 destination section ami the contents of the currem musical secUon to compose the 
transitional section. This transitiomil section is then passed to the performance engine 
for generation of a music sequence. 

The composition engine of the present invention also responds to a 
parameter from the application interface to change the personality of a music section. 
15 To change the personality of a section, the composition engine uses the information 
from the selected personality to change the chords of a musical section. Theengine 
may also alter the chords of the musical section to conform to the musical scale or ke> 
of the new personality. Because a scale change may alter the type of key for a 
musical section, for insumce from major to minor, this^haijge may significantly alter 
20 the music corresponding to a musical section. 

TTie system of the present invention may also include a performance 
engine to generates a music sequence from a musical section and a style. A style is a 
predetermined data stiwture that tiefmes the note panems for each instrument voice. 
The perfomiance engine of <he invemive system includes the capability of performing 
25 a motif in response to parameters received from an application program. A motif is a 
shon musical pattern that is typically associated with a particular character or event 
presented in a multimedia presentation. The perfoimance engine responds to 
f)arameters indicating the type of synchronization that should occur, and appropriate]) 
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synchronizes the playing of the motif seciion with the current musical section. The 
moiif section also includes a plurality of note panems for the motif. The perfonnance 
engine of the present invention may select one of the note panems for the motif and 
transpose the pattern so it corresponds to a musical section presently being performed 
5 for a multimedia scene. The variations for the musical sections arising from the ' 
composition method and the variations of the note patterns for the motifs help ensure 
that the motifs differ for each perfomiance. 

Because the system of the present invention is able to compose musical 
and transitional sections, transpose motifs* and alter the personality of a musical 
1 0 section based upon a user's interaction with a multimedia presentation, it usually 
provides new accompaniment to the scenes of a multimedia presentation for each 
perfonnance of the scenes. Because the application program may request music by 
only identifying a style, shape, and personality, the application interface of the present 
invention provides a simple method for composing a chord progression without 
1 5 requiring the application programmer to have knowledge of music theory. These and 
other advantages of features in the present invention shall become apparent to the 
reader in view of the accompanying drawings and detailed description. 

BRIEF DESCRIPTION OF THE DllAWINriS 
20 The present invention may take form in various components and 

arrangement of components and in various steps and arrangement of steps. The 
drawings are only for purposes of illustrating a preferred embodiment and processes 
and are not to be construed as limiting the invention. 

Fig. 1 is a block diagram of a system implementing the principles of 
25 the present invention; 

Fig. 2 is a block diagram of the composition engine shown in Fig. 1 ; 

Fig. 3 is a flowchart of the preferred process for composing musical 
templates in the composition engine shown in Fig. 1 ; 
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Fig. 4 shows a pFefefred set of signpost chord markers; 
Fig. 5 is a flowchart of the preferred process to place signpost^hord 
markers in a template used in the musical lemplate generator shown in Fig. 2; 

Fig. 6 is a data structure definition of the embellishment and groove 
5 commands used in the preferred process shown in Fig. 7; 

Fig. 7 is a flowchart of a preferred process to place embellishment and 
groove commands of the type shown in Fig. 6 in a musical template; 

Fig. 8 is a flowchart of a preferred process for calculatirig the groove 
level commands for a template; 
1 0 Fig. 9 is a data structure definition of a template constructed by the 

processes shown in Figs. 5, 7 and 8; 

Figs. lOA-D are data strucnires for a personality used by the musical 
section generator of Fig. 2 to compose a musical section; 

Fig. 1 1 is a flowchart of a preferred process which composes a musical 
1 5 section in the composition engine shown in Fig. 1 ; 

Fig. 12 is a data structure deflnition of a musical section generated by 
the composition engine of Fig. 1; 

Fig. 13 is a flowchart of a prelferred process for assigning signpost 
chord markers in a template which is part of the process shown in Fig. 1 1 ; 
20 Fig. 14 is a flowchart of a preferred process which builds a chord 

connecting path between two successive signpost chords for the musical section 
generator of Fig. 2: 

Fig. 1 5 is a flowchart of a preferred recursive process of musical 
section generator shown in Fig. 2 which traverses a path defined by next chord 
25 pointers to determine whether a chord connecting path between two successive 
signpost chords satisfies the criteria for a valid chord connecting path; 
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Fig. 1 6 is a aoy.xhm of a preferred process for music transitional 
section generator of Fig. 2 which composes a transition section between cunem and 
destination music sections; 

Fig. 1 7 is a flowchart for a preferred process of musical section 
personality convener of Fig. 2 which switches the personality of a music section: 

Fig. 1 8 is a preferred data format for represeming note data in the 
system of Fig. 1; 

Fig. 1 9 is a flowchart for a preferred process used to synchronize the 
performance of a motif to a music section; and 

Fig. 20 is a flowchart for a preferred process for perfoiming a motif by 
the performance engine shown in Fig. 1 . 



A system incorporating the principles of the presera invention is shown 
15 inFig. 1. Thesystem 10 includes an arbitrator 12. a composition engine I4.a 
performance engine 1 6, data storage 1 8. and an instniment interface 20. The 
arbitrator 12 preferably receives from an application program which is driving a 
multimedia presentation information or parameters about the shape. st> le. and 
personality for a requested musical perfonnance. Altemauvely. all or a ponion of the 

20 arbitrator 1 2 may be incorporated in the application program. Based upon the 
infonnation received from the application program, arbitrator 12 may access data 
storage 18 to provide musical sections and styles to performance engine 16 for 
generation of a music sequence, or pass parameters to composition engine 14 for the 
composition of a musical section. Additionally, arbitrator 12 receives feedback 

25 regarding the perfonnance of a musical section from performance engine 16 and 
provides all or a ponion of thai feedback to the application program. 

Further details of composition engine 14 are shown in Fig. 2. 
Composition engine 14 performs functions or processes to compose musical sections 
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in immediate response to user interaction with the aj^lication program. These 
functions are impleoKnted by musical tcmplate generator 22, musical section 
generator 24, transitional section ^neraior 26. and musical section pereonality 
converter 28. The musical template generator 22 generates a template data structure 
5 that defines the musical shape of a musical section. The musical section feneraior 24 
of composition engine U uses a musical template and a personality data structure 
(discussed in more detail below) received from arbitrator 12 to compose a musical 
section. The content of a musical section is provided in more detail below. This 
section may be provided to performance engine 16 for an interpretative performance 
10 or it may be returned to arbitrator 12 for storage on data storage 18. The transitional 
section generator 26 generates a musical section that is specifically tailored to 
transition from the performance of a current musical section to a destination musical 
section. The musical section personality converter 28 alters the chords of a musical 
section tiiat is currently being perfonmed with musical data from a second personality. 
' ^ The performance engine 16 uses a musical section and a musical style 

to genoate a musical sequence. The style data are predetermined and stored on data 
storage 1 8. Arbitrator 12 retrieves a musical style and provides die style to 
performance engine 16 to interpret the composed musical section. Additionally, 
arbitrator 12 may provide motif sections retrieved from a data storage 18 to 
20 performance engine 16. Arbitrator 12 provides the data structures in response to 

signals from tiie application program driving the multimedia presentation. The music 
sequence generated by performance engine 16 identifies the notes to be played by a 
musical device driven by the performance engine 16. The musical sequence 
information is provided to the device throiigh an ins&ument interface 20 which 
25 preferably is a Musical Instrument Digital Interface (MIDI). 

Performance engine 16 also provides the application program via 
arbitrator 12 feedback messages so the application program may coordinate the 
various components of die multimedia presentation. The feedback messages 
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pieferably indicate that a musical section has started, a musical section has ended, a 
musical section has been requested, a note has been played, a beat or measure has 
passed, a groove level has changed, or an embellishment has occurred. Other 
messages necessary for coordinating a multimedia presentation with a musical 
5 performance may also be used. 

Preferably, the arbittaior 12. composition engine 14, performance 
engine 1 6, and dau storage 1 8 are implemented on a computer system having at least 
an INTEL 386SX processor with at least two megabytes of RAM and at least five 
megabytes of disc storage space. The instrument interface 20 may be a MIDI such as 

1 0 that manufactured by MidiMan of Pasadena, California, or a sound card such as that 
manufactured by Ensonig of Malvern, Pennsylvania. Performance engine 16 is of the 
type as the one implemented in the SuperJAM!^ program available from The Blue 
Ribbon Soimd Works of Atlanta, Georgia. Preferably, composition engine 14 and 
performance engine 16 are implemented in the C-h- or C programming languages. 

1 5 A preferred process performed by the musical template generator 22 is 

shown in Fig. 3. This process specifies the complexity and location of musically 
imponant chords for a musical section and defines the musical activity levels and 
types for the section as well. The process begins by invoking a create signposts 
process (shown in Fig. S) which places signpost chord markers in an empty template 

20 data structure. (Step 40). After the signpost chord markers are placed in the template, 
a second process (shown in Fig. 7) is invoked to provide embellishment commands in 
the template. (Step 42). Preferably, the embellishment commands include groove 
level corrmiands which are related to a shape parameter associated with the template. 
Once the template has been generated, it may be used by the musical section generator 

25 24 to add the musical content for the section. 

The process for placing signpost chord markers in a template provides 
a framework for the later composition of a musical section. Signpost chord markers 
indicate a location for signpost chords in a musical section. Signpost chords are 
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chords that arc musically important to a musical section. For^xampic, choids based 
on the first, fourth, and fifth positions of a scale are typically regarded as musically 
significant. Signpost chord markers are preferably identified as an ordered set of 
elements such as the bit flags shown in Fig. 4. Each element defines a level of 
5 complexity for a chord. For example, SP. 1 may peprescnt a chord based on the root 
for the scale associated with a personality and SP_A may represent a chord that is 
based on a note less musically common to the scale than one built on the root. 
Preferably, each element SP^C to SP^F relates to a continuum of chord complexity 
within the scale. For example, SP^F may represent a very unusual chord for the^ale 
1 0 such as a diminished second chord in a major key. The signpost chord markers may 
be defined according to other characteristics such as position in a scale. 

The preferred create signposts process shown in Fig. 5 calculates 
musically appropriate locations in a template for signpost chords and marics these 
locations with signpost chord markers selected from the signpost choid marker set 
1 5 discussed above. Preferably, a weighted random number generator is used to generate 
an offset into the set of signpost chord markers. The weighted random number 
generator randomly generates an integer within the range of 0 to an upper limit which 
is usually passed to the generator as a parameter. The distribution of the integers 
returned by the generator is preferably weighted to the lower end of the range. Thus. 
20 the process shown in Fig. 5 tends to select signpost chord markers which represent 
less complex chords, although other criteria and methods may be used to select such 
chords for a template-like smicttire. 

The process of Fig. 5 begins by calculating the number of signpost 
chord markers, SPCounL that should be placed within a template. <Step'50). 
25 Preferably, this number is calculated by subuacting 1 from the4>inary logarithm t>f the 
number of measures for the template. For example, if the iemplaie length is 8 
measures then the binar>' logarithm of 8 is 3 since 8 equals 23. Thus,*r an 8 measure 
template, the number of signpost chord markers to be placed within the template is 2. 
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If the calculation of the signpost chord marker number exceeds 7. then the number is 
preferably reduced to be within the range of 1 through 7, since the preferred signpost 
chord marker set only has seven elements. 

Preferably, the weighted random number generator is used to generate 
5 a number used to select signpost chord markers from the signpost chord marker set. 
(Steps 52-54). After a marker is selected, it is preferably copied into an SPSign array 
and deactivated as a choice in the signpost chord marker set. (Step 56). A duration 
for the selected signpost marker, which is preferably 2 or 4 measures, is then 
randomly selected. (Step 58). The process then randomly selects whether a cadence 

10 flag should be set for the selected signpost chord marker. (Step 60), The cadence flag 
indicates whether cadence chords for the signpost chord marker which are identified 
in a personality should precede a signpost chord in the musical section to be 
composed. The cadence flag is identified by the symbol SP^CADENCE in Fig. 4. 
Signpost chord marker selection continues until the number of selected markers 

15 equals the calculated number of signpost chord markers. (Steps 62-66). 

^ Once all the signpost chord markers have been selected and placed in 

the SPSign array, the signpost chord markers within the SPSign array are placed in 
the appropriate locations in the template. This is done by placing the first signpost 
chord marker from the SPSign anay on the first beat of the first measure of the 

20 template, although other locations may be used. (Step 68). The process then 
increments by the niunber of measures indicated for the duration of the placed 
signpost chord marker (Step 70) and that location is examined to detennine whether it 
is the last measure in the template. (Step 72). If it is not, another weighted random 
number is generated which is equal to or less than the calculated number of signpost 

25 chord markers and used as an index into the SPSign anay to randomly select a new 
signpost chord marker. (Step 74). This signpost chord marker is then examined to 
see if it is the same as the 4ast signpost chord marker placed within the template. 
(Step 76). If it is. an anempi is made to randomly select another signpost chord 
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marker from the SPSign afray, (Step 78). Thefrcferred proems places the signposi 
chord marker selected by the second attempt in the templaie (Step 80), although the 
search for a different chord marker could continue until a different one is selected. 
The process of placing signpost chord markers continues until the last measure in the 
5 template is reached. At that point, the process selects either signpost chord marker 
SP^l or the first element in the SPSign array. (Step 82). These chords are preferably 
selected because they either represent a more traditional end for the section or, as a 
result of being the first element in the SPSign array, the most frequently selected 
signpost chord marker for the section. After the signpost chord markers have been 
1 0 inserted in the template, the process returns the template with the signpost chord 
markers. 

The create embellishments process shown in Fig. 7 is used to insert 
groove conunands and embellishment commands in the template. Preferably, 
embellishment and groove commands are used to indicate the level of intensity for the 

1 5 music within a section. Preferably, there are four embellishment conunands and four 
groove conunands. The preferred embellishments and groove commands are shown 
in Fig. 6. As shovm in that Fig., the four embellishment commands are fill, 
introduction, break, and ending. Musically, these tenns mean the following. Fill is a 
tenn to indicate a background musical perfonnance that adds musical activity in 

20 anticipation of a next measure. Introduction is a short musical performance that starts 
a musical section. A break is a reduction in musical activity in anticipation of a next 
measure. Finally, ending is a musically pleasing resolution of a musical section. 

The groove commands are identified as groove A, groove B, groove C. 
and groove D. These define an intensity level for the music with A preferably being 

25 the least intense and groove D being the most intense level. Intensity reflects the 
number of notes being played per unit of time measurement. The greater the number 
of notes played per umit of time, the greater the intensit\'. Of course, more groove 
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commands may be provided if a smaller gradation of intensity is desired or the 
intensity levels may be ordered from greatest to lowest intensity. 

The process for generating embellishment and groove commands uses 
the template in which the signpost chord markers have been placed and a parameter. 
5 received from the application program through arbitrator 12, that defines the overall 
shape of a template. This shape parameter describes the groove level changes over 
the time duration as defined for a template. Depending upon the shape defined, a 
groove range process places groove level commands in a template. Once the groove 
level conmiands have been placed in a template, they are examined to determine 
10 whether fill or break embellishment commands should be inserted into the template. 
These embellishment commands are included to further increase the number of 
musical sections which the composition engine may compose. 

A process for placing embellishment and groove level commands in a 
template is shown in more detail in Fig. 7. The process begins by passing the starting 
15 and ending groove levels for a section to a process (shown in Fig. 8) for placing 
groove commands in the template. (Steps lOOA-D). For a falling template shape, 
groove D is identified as the starting groove level and groove A as the ending groove 
level. (Step lOOA), For a level shape, groove C is the starting and ending groove 
level. (Step lOOB). A rising shape begins at groove A and ends at groove D. (Step 
20 1 OOC). For a peaking template shape, the process identifies groove A as the staning 
groove level and groove D as the ending level for the first half of the template and 
those identifications are reversed for the second half of the template. (Step lOOD). If 
no shape is defined the process preferably defaults to a level shape (Step lOOE). 
although other shapes may be used for the default shape. Additionally, other shapes 
25 may be defined for placing groove commands in the template. 

After the groove level commands are inserted into the template, the 
process examines the inserted groove commands to determine whether further 
changes should be made to the groove level commands. Where a groove level 
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command diliers from a previous groove level command, the process randomly 
dctennines whether to make additional changes. (Steps 102-106). If additional 
-changes are made, the process places a fill embellishment command in the measure 
before the groove command if the present groove command is for a groove C or D 
5 level. (Steps 110,114), If a groove D conunand precedes the current groove 
command, it also places a fill embellishment command in the previous measure. 
(Step 1 14). If none of these conditions exist and the add embellishment command 
path has been selected, a break embellishment command is inserted in the previous 
measure, (Step 1 12). The process for placing groove and embellishment commands 
10 in a template continues until the end of the template is reached. The process then 
returns the template wiib the inserted groove and embellishment commands. 

The preferred groove range process which places groove commands in 
the template is shown in Fig. 8. The process uses the time duration for the template, 
preferably measured in beats, along with the starting and ending groove commands to 
1 5 place groove conunands throughout the template. The process begins by locating the 
first signpost chord marker within the template. (Step 130). The process places the 
starting groove level at the first signpost chord marker in the template. The process 
then moves to the next signpost chord marker and calculates a groove command for 
that marker. Preferably, the groove command is equal to the absolute value of the 
20 difference between the starting groove level and ending groove level multiplied by the 
time (preferably measured in beats) at the present location within the template, and 
this quantity is divided by the total time for the template to generate a groove level. 
(Step 134). 

Having calculated the groove level, it is then compared to the last 
25 groove level placed in the template to determine if it is different. <Step 1 36). If it is 
not and six measures have passed since the last groove level change, a groove level 
different than the last groove level placed in the template is randomly selected and 
placed at the signpost chord marker. (Step 140.) Usix measures have noi passed. the 
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process searches for the next signpost chord marker. (Step 142). If the calculated 
groove command is different than the last groove conunand, the process increases the 
difference for the calculated level. If the last groove command is greater than the 
calculated level, the calculated groove level is decremented to further decrease the 
5 difference from the prior groove level command. (Steps 144, 146). Otherwise, the 
groove level is incremented to increase the difference. (Steps 144, 148). This 
preferred augmentation of groove level differences further enhances the interesting 
qualities of the musical section composed by using the template. The groove 
command process continues until there are no more signpost markers within the 
1 0 template and the process returns the template with the inserted groove level 
commands. 

After the musical template section generator 22 has perfonned the 
processes described above, a musical template defining the signpost chord locations 
and music intensity levels has been constructed. The preferred data structure for a 

1 5 musical template is shown in Fig. 9. This dau structure may now be stored by 
arbitrator 12 in data storage 1 8 for later use or it may be passed to musical section 
generator 24 for composition of a musical section. Additionally, predetermined 
templates not generated by musical template generator 22 may be stored in data 
storage 18 for composition of a musical section. The musical section generator 24 

20 uses a template, preferably retrieved from data storage 1 8 by arbitrator 1 2, and a 
personality to compose a musical section. 

A personality is a data structure that includes sufficient information for 
composing a chord progression for a section. This information is structured so that a 
different section may be composed in response to composition conunands even 

25 though the same template and personality may be used. Thus, the process for 

generating musical sections of the present invention may compose original musical 
sections that differ regardless of whether it generates a template or is supplied one. 
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PFeferably. the personaliiies are .(Mined iMior to use of the system 
shown in Fig. 1 and are stored on data storage element 1 8. The^xemplaiy j)ersonality 
and associated data structures shown in Figs. lOA-D include axhord «ntT>' list, a 
signpost chord list, a scale pattern, and a choid palette. The chord entry list is an 
5 acyclic graph of chord connecuons that "fit" the mood of the personality defined by 
die structure. Each chord in the list has a next chord data structure that has one or 
more jwiniers, each of which point to a next chord which may follow the chord. Each 
such pointer also has a probability weight associated with it, to faciliute selection of a 
next chord. In this way, a chord progression built torn the chords selected from the 
1 0 chord list of a particular personality is not always the same. The signpost chord list 
identifies the chord or chords that correspond to each signpost marker. The scale 
panem is preferably a string of twelve (12) bits to identify the notes of a scale for a 
personality. For example, a major scale string would be "lOlOlIOlOIOl," while a 
minor key would be "101 lOlOlOI 10." Preferably, the chord palene is a list of chords. 
1 5 one chord for each note of a two octave range with each note of the two ocuive range 
forming the root of its corresponding chord. 

Preferably, a personality is a data sovctiuv as shown in Fig. lOA. That 
structure includes a list of chords and pointers from which a chord progression may be 
defined, a list of sign post chords that fit the personality, the scale for the personalit> . 
20 and an array of chords for a two octave range. Each note of the two ocuive array has a 
corresponding chord within the chord array. The preferred structure for Uje chord 
array is called a chord palette and is shown in the figure. A prefcired data structure 
that defmes the signpost list is shown in Fig, lOB. That structure includes a pointer to 
link the signpost chord list, identification of the signpost-chord and the associated 
25 <adence chords, and a set of flags which indicate which signpost chord markers 
-correspond to this signpost chord. 

The prefeired dau structure that defines a chord is shown in Fig. 1 OC. 
That structure includes a definitioncf the notes-of the chord, the^cale of the chord. 
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and the rooi note of the chord. Two data fields aie provided in the prefeired structure 
which may be used to identify the measure and beat within a section on which the 
chord is located. 

Chord entry data structures have the preferred form shown in Fig. lOD. 
5 The chord entry structure contains a next chord structure for constructing a chord 
progression, the musical identificaUon of the chord (such as Cmajor). and Hags which 
are to used to idenufy whether the chord is the beginning or ending chord of a 
Fogression. The next chord dau structure includes a flag which indicates whether 
the chord is in a chord path being walked, a pointer to a next chord to evaluate for the 
10 connecting chord path, the probability that the next chord should be selected as a next 
chord candidate, preferably expressed as number from 0 to 100. and the maximum 
and minimum number of beats to the next chord. While the data structures in Figs. 
lOA-D are the preferred ones for the system and processes of the present invention, 
other structures may be used which include the same or similar information for 
1 5 defining chords and their musical relationships. 

The preferred process performed by musical section generator 24 for 
generating a musical section is shown in Fig. 1 1 . It begins by having an assign 
signposts process (shown in Fig. 13) assign a chord from the signpost chord list of a 
personality to each signpost chord marker within a template. (Step 160). The process 
20 selects a starting and ending chord pair and determines if the cadence flag is set for 
the ending chord. (Step 164). If it is. then the ending chord is replaced with the first 
cadence chord. (Step 168). The build chord conneaion process (shown in Fig. 14) 
then finds the connecting chord path between the starting and ending chords. (Step 
166). If the cadence flag was set (Step 1 70). the remaining cadence chords and 
25 signpost chord is added to the chord connection list. (Step 1 72). The timing of the 
chords with respect to the measure boundaries is then adjusted*. Preferably, the 
process evenly spaces the chords over the section and then determines whether the 
chords not on measure boundaries may be moved to an adjacent measure boundary. 1 f 
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SO. the chord time is adjusted, otiierwise the chord is left at its cuiwnt position. A 
chwd may not *e moved to a measure boundary if a chord already occupies the 
boundary. When aJI of the signpost chords have been connected and adjusted, the 
chord progression is written to a musical section. (Steps 1 80J 82). Finally, the 
5 embellishment and groove level commands of the template are written to the musical 
section. (Step 184). 

A preferred data structure for a musical section is shown in Fig. 12. 
The sirucftire includes the style, personality, chord progression, groove and 
embellishment commands, MIDI sequence data, section length, tempo, and root of the 

10 key. The musical section generator 24 generates the chord progression and places the 
commands in the data structure. The style, personality, section length, tempo, and 
key root are provided by arbitrator 12 either from d«a storage 18 or from the 
application program. The MIDI sequence dau is predetermined data that is not used 
by composition engine 14 for its processes and does not form part of the present 

IS invention. 

The preferred process which assigns signpost chords from the signpost 
chord list in a personality to each signpost chord marker in a template is shown in Fig. 
13. This process begins by selecting the first signpost chwd marker in theiempiate. 
(Step 1 90). The process then scans the signpost chord list associated with a 

20 personality to find all the signpost chords that correspond to the selected signpost 
chord maricer. (Step 192). The process then randomly selects one of the 
correspondmg signpost chords and assigns it to the selected signpost chord marker. 
{Steps 194, 196). The process then looks for another signpost chord marker in -the 
template. (Steps 198, 200). If there is, it determines if a priorsignpost chord marker 

25 is the same as the current signpost marker. (Steps 202, 204). If it is, the signpost 
chord assigned to the prior signpost chord maricer is assigned to the current signpost 
marker and the process continues by looking for another signpost chord marker. 
(Steps 206 and 198. 200). If the current signpost marker is not the same as a 
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previously selected signpost chord marker, the signpost chord list in the personalit>' 
for that signpost chord marker is scanned and one of the corresponding chords in the 
list is randomly selected for assignment to the signpost chord marker. This process 
continues imtil all the signpost chord markers in the template have been assigned a 
5 signpost chord. 

The preferred process for building a chord connection path between 
two successive signpost chords (the starting and ending chords) is shown in Fig. 14. 
This process receives as parameters the starting and ending chords, the chord activity 
level, and the beats per measure. Preferably, chord activity level is a parameter 

1 0 having a value of 0 to 3 which defines how frequently chords change. In the preferred 
scheme. 0 is the least amount of change which preferably corresponds to a chord 
change every two measures and 3 is the largest which preferably corresponds to a 
chord change on each beat. The process begins by determining the number of beats 
for the template. This is done by computing the length of the template in measiu^s 

1 5 and multiplying that number by the number of beats per measure. The value for the 
maximum number of chords is set to a number corresponding to the number of beau 
for the template. Preferably, the maximum number is the number of beats expressed 
as a binary number shifted right by the value of the activity level although other 
computatonal schemes may be used. The minimum number of chords for the section 

20 is set to one-half of the maximum number. (Step 220). 

The process then searches to see if a previous chord connection has 
been generated that began with the same starting signpost chord. (Steps 222-226). If 
there is such a previous chord connection, the walk tree process (shown in Fig. 1 S) is 
used to see if that chord connection path may be used to connect to the starting chord 

25 to the current ending chord. (Step 228). If it can be. that chord connection path is 
selected and the process ends. (Step 230). If the chord coimection path carmot reach 
the ending signpost chord, then the chord entries in the chord entry list of the 
personality data structure are searched to find the first one that matches the starting 
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signpost chord. <Step 232). If there is a match, then the walk tt«e process is caikd to 
determine if the next chord pointer may be -used to forro a trhordxonneciion path to 
the«nding chord. (Steps 234, 236). I fit -can *e, thai -connection list is selected and 
returned to the music section ^nerating process. (Step 238). If it cannot be 
5 constructed, then the chord entry list of the personality is searched for another entr>' 
that matches the current signpost chord (Step 240) and the process continues. <Sieps 
234-238). If no chord entry within the personality matches the starting signpost chord 
(Steps 234 and 242,244), the minimum number of chords and beats are adjusted to 
provide a better chance of success for finding a path (Step 246) and the process is 
10 repeated. (Steps 226-240). Preferably, the minimum chord number is reduced 
because a path connecting the starting and ending chord may probably be found if 
fewer chords are needed. 

If the process does not locate a chord connection path after a 
predetermined number of tries (Step 244), a chord connection is built between the two 
1 5 chords by using the cadence chords associated with the ending signpost chord. If the 
ending chord is a cadence chord then the connecting path is composed of the starting 
and ending chord. Cadence chords are preferably idemified by a data structure 
associated with a signpost chord entry in*e signpost chord list. Preferably, one or 
two cadence chords are in the data stiucnire although other numbers of such chords 
20 may be used. Cadence chords are preferably chords that musically resolve to the 
signpost chord entry. 

The walk tree process is shown in fig. 15. This process is a recursive 
routine that determines whether a chord connection path between ihe -starting and 
ending signpost-chords is possible. The process is initiated v^th a specific chord-entry 
25 selected from the chord entry list of a personalit>-. The process looks at the next chord 
pointer of the chord entry and evaluates whether it is the last chord and. if it is. 
determines whether the path sati^Sfles the chord activity and beat<equirements. If it 
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does, the connecting path is identified. Otherwise, the process continues to search for 
a valid connecting path between the starting and ending signpost chords. 

The walk tree process of Fig. 1 5 begins by dctennining whether there 
are too many chords between the starting and ending signpost chords currently. (Step 
3 250). If there are. the process returns a Boolean value that indicates a valid 

connecting path was not found. If there are not too many chords in the current path, it 
evaluates whether the current chord entry matches the ending signpost chord (Step 
252) and. if it does not, evaluates whether it is following a previous chord path or not. 
(Step 260). If it is, it selects the next chord entry from that previous path (Step 262) 

10 and recursively calls the walk tree process if the chord entry is not the end of the prior 
path. (Step 264, 266). If the process can reach the end of the path then a true value is 
returned and the chord connection path is used. (Steps 268, 258). If the prior chord 
path carmot be traversed to the end, then that chord path is cleared as being available 
for the current path search. (Step 270). 

15 If no previous chord path is being followed or if the previous chord 

path has been cleared, then the process randomly selects the next chord entry 
identified by the next chord data pointer of a chord entry in the chord entry list of a 
personality. (Step 272). The probabilities associated with the next chord pointers are 
used to randomly select one of the next chords. After a chord entry corresponding to 

20 the next chord is selected, the walk tree process is recursively called to see if a path 
can be traversed to the ending signpost chord. (Step 276). If the routine is able to do 
so. then a Boolean value indicating the chord connection path is valid is returned. 
( Steps 278, 280). Otherwise, the process indicates that no connecting chord path is 
available. (Steps 278, 280). In this maimer, once a nextchord pointer is marked as 

25 not leading to the end chord, it is no longer selected. 

The preferred process performed by transitional section generator 26 
shown Fig. 16. This process composes a transitional music section for transitioning a 
performance from a current music section to a destination music section. The 
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transitional secuonis-composed^y-combiniug the styk data for-ihe<urrem section 
with the personality of <he desUnaUon secUon. The process-then finds a-signposi 
chord from the personality that most closely matches the fiisi chord of the destination 
section and which has an associated first cadence chord that most-closely matches the 
5 scale of the^urrent section. The<adence chords for diat s^ignpost chord are written to 
the first measure of the transition section. If the transitional section is two measures 
long, the matching signpost chord emhellishment commands are placed at the firet 
beat of the second measure. If the transitional section is one measure in length, the 
embeHishment command is placed at the first beat of the measure, finally, the^roove 
1 0 level command in the current section active at the transition time is copied to the firei 
beat of the first measure of the transitional section. The transitional section may then 
be provided to die performance engine 16 or to arbitrator 12. 

In more detail, the preferred process for^enerating a transitional 
section is shown in Fig. 1 6 The process is passed a pointer to die current and 
1 5 destination sections. Ute time (preferably in measures) where the transhion occurs, 
and a flag indicating wliether the transitional section is one or two measures in length. 
The process begins by creating a section data strucnae into which the style data oUhe 
current section and Uve personality of the destination section are copied. j(Sieps 300. 
302). The personality is then scanned for the signpost chord closest to the first chord 
20 of the destination section (Step 304). Preferably, the term "closest" means a chord 
having the most notes in conmion with the notes of die chord in xhe destination 
section and the least number of notes that are outside the scale of the current section 
personality. The cadence chords for this signpost chord are then assigned to the first 
and middle beats of die first measure of the transitional section. (Step 312). 
25 If die transitional section is a two measure section (Steps 3 1 4. 3 1 6). die 

transitional section is made 2 measures long (Step 3 1 8) and Uie signpost chord to 
which die cadence chords lead is placed at die -beginning of the second measure, along 
with any -embellishment commands at die transition point. (Step 320). If the section 
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is one measure in length (Step 324). the embellishment commands are placed at the 
first beat of the measure. (Step 326). The process then copies the ^oove level 
command active in the current section at the time of transition to the transition 
section. (Step 322). 

5 The preferred process for the musical section personality convener 28 

which su^itches the personality of a musical section is shown in Fig. 1 7. This process 
updates all the chords of a section to conform to a new personality. The process 
receives a musical section, a new personality for the section, and a flag that indicates 
whether the music scale for the personality associated with the music section should 

1 0 be converted to the music scale for the new personality when sening root chord 

values. The process begins by selecting the first chord in the section to be convened. 
(Step 400). The chromatic value of the scale root for the personality of the section is 
subuacted from the chromatic root value of the chord. (Step 404). This subtraction 
transposes all notes of the section to a common key, preferably C major, for 

1 5 conversion. If the flag for the music scale change is not set. the process reads the 
chord from the personality chord palette that corresponds to the note of the common 
key in the preferred two octave range. (Step 412). The chromatic value of the scale 
root for the section is added to the root of the selected chord (Step 414) and the 
process continues looking for new chords to convert. (Step 416). If the track scale 

20 flag is set. the note of the conimon key is convened to its diatonic scale value in the 
original personality scale. (Step 408). That value is then used to select the note that 
corresponds to that scale value in the new personality scale (Step 410) and the 
corresponding chord for that note is read from the personality chord palette. (Step 
412). The chord is then transposed for the musical section as discussed above. When 

25 all the chords have been convened, the section is ready for the performance engine. 

An example is helpful in understanding the personality conversion. 
Preferably, the root notes for chords are defined by a corresponding chromatic value 
which preferably defines the beginning C of a two octave range as 0 and increments 
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by I for-each chromatic one half-step up to the \ alue of 25 for the^nding C of the 
range. If the^oot note is a B for a G major scak in the first octave of the section to be 
convened, then the corwsponding-chromatic values are 1 1 for the root note and 7 for 
the scale root. The diffeienec defines the chromatic value for the note in the common 
5 key which is 4 or E in the C major key. If no scale change is to take place. the<hord 
haviog E as its root note is selected from the chord palette and all the notes of the 
chord are transposed to the key of die section by adding the scale root back which in 
the example is 7. Thus, the process^onveits the root notes of a musical section to the 
common C major key which is preferably used for all chord paieties-so a chord that 
1 0 corresponds to the new personality may be selected and then transposed to key for the 
musical section. 

When the personality has a new key, then the root note in the common 
key must be transposed to the new key. In the example above, the E or 4 chromatic 
value corresponds to the third in the common C major key. Suppose the key for the 
15 new personality is a minor key. First, the process selects the third of C minor which 
is Ei and selects the corresponding chord from the chord palene. The chord is then 
transposed to the new key by adding the chromatic value for the section scale root 
note, which is 7 in the example, to transpose the chord to a root of B< which is the 
minor third of the G key. Thus, the process has selected a chord with its root in the 
20 minor third to replace the chord with its root on the major third. This modification 
alters the chord progression of the musical secUon prior to conversion to conform <o 
the new personality. 

To generate a music sequence for a musical device, the perform^ce 
generator preferably uses a style and a musical section. A style preferably includes ai 
25 least identification of the note pattern for-each instrument voice that may be 

performed by the device. The notes comprising a note pattern ar« transposed by 
performance engine 16 according to the chord progression defined by the musical 
section. Because the composition^ngine 14 of the^jresent invemion composes chord 
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progressions for a musical section using random selection and weighted probabilities, 
the chord progressions var>' from performance to performance and the corresponding 
transposition of the notes and resulting music sequence also varies. 

A preferred data format for the representation of notes within a style 
5 are shown in Fig. 18. This data format includes four data fields, preferably used to 
define the notes. The first data field defines an octave in which the note is located. 
The second data field identifies the position of the note within a chord. Preferably, 
this field may have the values 0 through 3 which preferably represent the first three 
notes of a chord triad and the seventh note of a chord. Thus, these numbers identify 
1 0 the root, third, fifth, and seventh of a octave. The third data field identifies the scale 
position of the note above the chord position. For example, notes of a C7 chord. C. E. 
G and B, would be represented by the numbers 1, 2, 3, 4 in the second data field, 
respectively, and the number 0 in the third data field. If the chord being performed in 
the instrument voice of a style is comprised of the notes, F, B^, the value for the C 
1 5 note would remain the same as the example just discussed. However, the F note 
would be represented by a 2 in the second data field and a 1 in the third data field, 
which represents the next scale note in the C major scale above the third of the C 
major chord. The B' note would be defined by a 3 in the second data field, a 1 in the 
third data field, and a 1 in the fourth data field. The fourth data field represents a half- 
20 step out of the scale w hich preferably is a half-step up, although a note representing 
scheme in which fourth data field represents a half-step down may also be used. 

The performance engine 16 uses the dau values of the notes within a 
note panem and the chord progression of a musical section to define a music 
sequence. For example, if the notes C and F in a note panem are defined as set forth 
25 above and a chord in a chord progression dcfmed by a musical section is E major, the 
performance engine 16 interprets the second data field for the first note, C. as being an 
E (first note in the uiad on the chord root) with no adjustment made for the scale 
position or for the half step adjustment fields. For the F, the performance engine 
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correlates the F note position within the chord <ihe second<h(Md noieposiiion) to be a 
G • and the I scale position value to represent an A. Thus, <he perfwmance engine 
generates music sequence data that causes a musical instrument for the identified 
instrument voice to play an E and an A, even though the predetermined note pattern 
5 defined a C and F. As a result, the<:hord progressions composed by the composition 
engine 14 cause the performance generated by performance engine 16 to v»y. 

Preferably, the style data includes a plurality of variations for the note 
pattern to be played for a panicular instrument voice. These variations further 
enhance the combinations that may be available to alter the performance of a musical 
1 0 section. More ^ifically, this type of style structure may be used ao implement a 
motif and a niunber of variations for that motif When the motif is performed during 
the performance of a musical section* the notes of the motif are simply u-ansposed as 
discussed above for the chord progression defined v^ithin the musical section. In this 
manner, the motif may be varied not only by the predetermined variations within the 
1 5 motif, but by the chord progressions composed by the composition engine in response 
to the user's input supplied through the application program. 

The process used by the performance engine to perform a motif is 
shown in Fig. 19. This process synchronizes the performance of a motif to the current 
section performance. The process begins by determining whether the performance of 
20 the motif should be synchronized to the next unit of time, the ^lext musical beat, or the 
beginning ofthe next measure. (Steps 500-304). If any of those synchronization 
constraints are required, a timeshift calculation as indicated in the figure is made to 
define the time at which the motif should begin. (Steps 506-510). The calculated 
timeshift is added to the motif perforrnance time. (Step 514). If there is no need for 
25 synchronization, no time shift is added to the motif performance time. (Step 512). 
The motif pattern and performance time are then provided to the performance engine 
for generation of the music sequence. 
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y^J The preferred process for executing a motif within the performance 

generator is shoun in Fig. 20. That process begins by randomly selecting one of the 
plurality of note pattern variations which defmes the notes for an instrument voice 
within a style. (Step 540). The process then waits for a click of lime. (Step 542). A 
5 click of lime is defined as being the smallest unit of music time resolution which is 
preferably an eighth note or eighth note triplet in duration. After deteraiining whether 
the end of a motif has been reached (Step 544), the chonl and key for the musical 
section currently being performed are determined. (Step 546). Alternatively, the 
chord and key may be provided by arbiu-ator 12. The process continues by selecting 

1 0 the first note of the pattern for the motif within the current click. (Step 548). The 

process then determines whether the note selected is within the pattern currently being 
perfomied for the instrument voice (Steps 552, 554) and if it is, transposes the note to 
the current key and chord for the music section (Step 560), if the note is not a drum 
part (Step 558), in the manner discussed above. The uansposed note is then translated 

1 5 to musical device sequence data such as MIDI events (Step 564), \«4iich are well 

known within the an. Once all the notes within the cuncnt click have been transposed 
and converted to sequence data (Step 550). the process continues by incrementing the 
time click and deiennining whether the last click has been evaluated. (Step 544). If it 
has. the process terminates. Otherwise, the process continues until all notes of the 

20 motif within the variation being played for a musical voice have been transposed and 
convened. 

^ — In use, a user begins the execuiion of an application program which 

results in a multimedia presentation. The application program typically identifies a 
musical section for an initial scene that is visually presented to the user and the 

25 arbitrator 1 2 provides the section and style to the performance engine 1 6 to 
commence perfomiance of musical data. 

As the user interacts with the application program through an input 
mechanism, an event may occur which signals a change in the music to be performed. 
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In response to that inieraciion, <he application pro tam may liequest the composition 
of a musical section that-confonns to the user's inieraction by identifying a style, 
shape, and personality for the requested music. In response to this request, 
composition -engine 14 may generate a template and then use that template to 
5 compose a music section. Aliematively, arbitrator 1 2 may provide a template 

conesponding to the request from the application program and provide that template 
to the composition engine 14 for composition of a musical section. After the musical 
section has been generated in accordance with the processes described above, the 
musical section may be provided to the performance-engine 16 directly or indirectly 
10 through the arbitrator. Arbitrator 12 also supplies a style40-performance<ngine Hso 
h may convert the musical section to music sequence data which is supplied to a 
musical device through instrument interface 20. 

Arbitrator 12 may also .generate a request to generate a musical 
transition section or to change the personality of acurrent musical secuon in response 
15 to a user s interaction. The generation of the music transitional section and the 

conversion of a musical section to a new personality is^jerformed in accordance with 
the processes discussed above. The music transitional section or the-section 
converted to the new personality may be supplied directly to the perfoimance engine 
16 indirectly or through arbitrator 12. 
2^ Arbitrator 1 2 may receive aconunand from the application program to 

play a motif associated with some action that the user has initiated through the ii^ut 
device. In response to this, arbittator 12 supplies a motif note |)aiiem to the 
performance engine 16. Peifoimance engine \6 then synchponizes the performance of 
the motif and transposes it to thecunently performed music section to augment the 
25 ongoing music performance. These processes may continue until the user terminates 
interaction with the multimedia.pra!gram. 

While the present invention has been illustrated 4)y the description of 
prefciied and akemative«mbodiments and processes, and while <he preferred and 
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aliemative embodiments and processes have been described in considerable detail, ii 
is not the intention of the applicant to restrict or in any way limit the scope of the 
appended claims to such detail. Additional advantages and modifications will readily 
appear to those skilled in the an. The invention in its broadest aspects is therefore not 
S limited to the specific details, preferred embodiment, and illustrative examples shou*n 
and described. Accordingly, departures may be made from such details without 
departing from the spirit or scope of applicant's general inventive concept. 

What is claimed is: 
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1 . A system for composing music in response to a user's 
interaction with a multimedia pFesentacioncomprising: 

an application program interfac-e^or«ceiving parameters identifying 
music related to said user's interaction with said multimedia presentation; and 

a composition engine for composing a musical section corresponding 
10 said parameters so that a user perceives the performance "of the jiiusical section to 
be felaUKi to said user's interaction with said multimedia presentation. 
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2. The system of claim 1 • said composition engine further comprising: 

a musical template generator for generating a musical template to 
defme a musical -shape for said composed musical section. 

5 

3- The system of claim 2 wherein said musical template generator selects 

signpost chord markers from a plurality of signpost chord markers to place within said 
generated musical template. 

10 4. The system of claim 2 wherein said musical template generator 

randomly selects signpost chord markers from a plurality of signpost chord markers to 
place within said generated musical template. 

5 • The system of claim 3 wherein said musical template generator places 

1 5 said selected signpost chord markers within said generated musical template. 

6- The system of claim 5 wherein said musical template generator 

randomly selects a duration for said signpost chord markers placed within said 
generated musical template. 

20 

The system of claim 2 wherein said musical template generator places 
embellishment commands in said generated musical template. 

8. The system of claim 2 wherein said musical template generator places 
25 groove level commands in said generated musical template. 

9. The system of claim 8 wherein said musical template generator 
randomly places embellishment commands in said generated musical template in 
correspondence with said groove level commands placed within said musical 

30 template. 
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10. The system of claim 9 wherein said musical template feneraior^>l»es 

one of aTill and a br-e^ embellishment command in corre^ndence with said groove 
level commands placed within said musical lemplaie. 

5 11. The sysiem ofclaim 8 wherein said musical template generator 

generates said groove level conunands from a starting and an ending groove level 
commands. 

12. Thc-system of claim 1 , said composition engine further 

10 comprising: 

a musical section generator for generating said musical^ction from a 
musical template and a personality, said musical template defining a musical shape 
for said musical section and said personality defining musical chord data for said 
musical section. 

15 

1 3 • The system of claim 1 2, wherein said musical section ^nerator selects 

signpost chords to place in said musical section from a signpost chord list in said 
personalit>\ 

20 14, The system of claim 1 3 wherein said musical section generator places 

said selected signpost chords in said musical section in conespondence with signpost 
chord markers in said template. 

1 5 . The system of claim 1 2 wherein said musical section generator selects 
25 groove level commands from said musical template to place in said musical section. 

16. The sysiem of claim 12 wherein said musical section generator se4ecis 
embellishments -commands from said musical template to place in said musical 
section. 

30 
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17. The system of claim 1 2 wherein said musical section generator 

generates a chord progression for said musical section from a chord entry list in said 
personalit}'. 

5 18. The system of claim 12 wherein said musical section generator 

generates a chord progression for said musical section from a chord entry list and a 
signpost chord list in said personality. 



10 



1 9. The system of claim 12 wherein said musical section generator 
generates a chord progression for said musical section from said signpost chord 
markers in said musical template and a chord entr>' list and a signpost chord list in 
said personality. 

20. The system of claim 12 wherein said musical section generator selecu 
1 5 next chord pointers to select said chords for said chord progression. 

2 ^ • system of claim 20 wherein musical section recursively walks a 

path defmed by said next chord pointers to select said chords for said chord 
progression. 

20 

22. The system of claim 1, said composition engine further comprising: 

a music transitional section generator for generating a transitional 
section for transistioning from a current musical section to a destination seaion. 

25 23. The system ofdaim 22. wherein said music transitional section 

generator selects a first signpost chord from a personality associated with said 
destination musical section which corresponds to a chord of the destination section 
and which has an associated first cadence chord that corresponds to a scale of the 
current section. 

30 
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24. The system 'f claim 1 . futher comprising: 

a musical^iion personaliiy convener for changing a 
chord progfession of a cuireni musical section to corr-espond to another 
personality. 

5 

25. The system of claim 24, wherein said musical secuon personality 
converter selects a chord from a chord palene in said personality which corresponds to 
a root note of a chord selected from said current musical section and transposes said 
selected chord palene chord tocoirespond to said root note of said chord Irom said 

1 0 current musical section. 

26. The system of claim 25 wherein said musical section personalit)' 
converter transposes said root of said selected chord from said current musical section 



15 



to a key associated with said another personality. 

27- The system of claim 1 further comprising: 

a performance engine that performs a motif in accordance 
to a style and a musical section. 



20 28. The system of chiim 27 wherein said performance engine transposes 

notes in a note pattern of said motif to correspond to a key and chord of said musical 
section. 



25 



2^ The system of claim 1 . further comprising: 

a performance engine for generating music -sequence data 
from said musical section and a style, said music sequence data being 
transmitted to a musical devicecoupled to said performance engine 
through an instrument interface. 

system ofclaim 29 wherein said instrument intefface is a MIDI. 
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31. A process for varying ihc musical accompaniment of a muliirocdia 

presentation so the accompaniment varies in response to a user's interaction, 
comprising the step of: 

composing a musical section in response to parameters received from 
5 an application program driving the multimedia presentation, said composed musical 
section being performed by a perfonmance engine substantially contemporaneously 
with said user's interaction with the multimedia presentation. 



10 



32. The process of claim 3 1 fiinher comprising the step of: 

composing a chord progression to place in said composed musical 

section. 



33. The process of the prior claim 32 ftmher comprising the step of: 
selecting musically important chords to define a template for said 

1 S chord progression; and 

connecting chords between said musically important chords to form 
said composed chord progression. 

34. The method of claim 33, further comprising the step of: 

20 selecting musically important chords from a set of signpost chords; and 

selecting said connecting chords from a list of chord entries. 

35. The process of claim 34. said selecting connecting chord step fiinher 
including: 

25 recursively walking a path of connecting chords by using next chord 

pointers. 

36. The method of claim 35, said walking step fiinher including: 

using weighted probabilities associated with said next chord pointers to 
30 recursively walk said path of connecting chords. 
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37. The process of-claim 32. said process funher-comprising the -step of: 

placing embellishment commands in said composed musical section. 

5 38. The process of claim 32. funher comprising ihe step of: 

placing groove levcl^ommands in said composed musical section. 

39. The process of^laim 38, said placing groove level^ommandsstep 

further including: 

ordering said groove level commands in correspondence with a 
musical template shape. 



10 



40. The process of claim 3 1 , funher comprising the stq) of: 

composing a transitional section to transition a peifoniiance from a 
1 5 current musical section to a destination musical section. 

^ ' • The process of claim 3 1 , further <omprisin£ the step of: 

converting a personality of a current musical section to another 

personalit}'. 

20 

^2- The process of claim 3 1 , funher comprising the step of: 

performing a motif in accordance uiih said composed musical section. 
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43. A composition engine for composing chord progressions comprising: 
an arbitrator for receiving parameters for composing a musical section; 

and 

a musical section generator for generating said musical section from a 
S musical template and a personality received from said arbitrator; 

44. The composition engine of claim 43, wherein said musical section 
generator generates a chord progression from signpost chords corresponding to said 
personality. 
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II Signpost marfcerbits (used by SignPost and Command structures) 



« define SPI 0x100 

#defineSPA i 

#d8fineSPB 2 

# define SP C 4 

# define SP.D 8 

# define SP*E Oxio 

# define SP_F 0x20 

# define SP_CADENCE 0x8000 
chord. 



// Choose a chord based on the root note. 
// Choose a chord that is very familiar. 
// Choose a chord that is less famifiar. 
// Choose a chord that is less familiar than B. 
//Choose a chord that is less familiar than C. 
// Choose a chord that is less familiar than D. 
//Choose the most unusual chord. 
//Use Cadence chords leading up to Sign Post. 



II 



Groove and Embellishment command bits (used by Command stmcture) 



define CMD.FILL i 

define CMDJNTRO 2 

define CMD BREAK 4 

define CMD_END 8 

define CMD A OxIO 

define CMD_B 0x20 

define CWID.C 0x40 

define CMD.O 0x80 



//Fill 

// Introduction • used to start 

//Break 

//Ending 

//Groove A (lowest intensity.) 
//Groove B (more intensity.) 
// Groove C (normal intensity.) 
//Groove D (heightened intensity.) 



Class Template { 
pubiic: 
int 

Command' 

}: 

class Command { 

public- 
Command* 
short 
DWORD 
DWORD 

}: 



m.measures: // Length of template, in measures 
m_pcommandlist; // Linked list of command markers 



ni_pnext: 
m_measure; 
m_command; 
m.signpost; 



//Linked list of Commands. 
//Time of command, in measures. 
//Groove and Embellishment flags (FIG 5 ) 
// SignPost chord marker flags (FIG. 9.) 
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SPCountsln2(ineasu(e$)-1 
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RANGE 1 THROUGH?. 
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THROUGH ARRAY. 
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SCAN THROUGH THE SPChoice 
ARRAY, COUNTING EVERY 
ACTIVE SignPostMAfM(Efl. 

UhfTILTHENlfiSiGnPostMARKEfl 
IS REACHED, COPY IT INTO THE 

SPSwn ARRAY AT POSmON 
INDEX. AND DEACTIVATE IT 
INTHESPCtl0iC€ARRAY. 
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RANDOMLY CHOOSE 
A DURATION FOR 

THESignPostOF 

20R 4 MEASURES. 
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WHETHER OR NOT THE 
, SionPosI SHOULOHAVE 
\lHe CADENCE FUG SET. 
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INCREMENT INDEX 
BY ONE. 
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PLACESPSigrrfOlAT 

FIRST MEASURE 
IN THE TEMPLATE. 



N = W#ledfiand(7.|NDEX) 
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100A 



CAUGtooveRange(3,0)TO 

BULD GROOVE CHANGES 
THAT START AT GROOVED 
AND DROP TO GROOVE A 



r 



100B 



CALLGrooveRange(2i)TO 

BULD GROOVE CHANGES 
THAT START AT GROOVE C 
AND END AT GROOVE C 



100C 



CALLGroweRangeMTO 
BULD GROOVE CHANGES 
THAT START AT GROOVED 
AND DROP TO GROOVE A. 



100D 



CALL GFOoveRange (0^1 FOR 

THE FIRST HALf OF THE 
^TEMPLATE, THEN CALL 

6fDweRange(3.0)FORTHE 

SECOND HALF. 



DEFAULT SHAPE CALLS 

6fooveRange(2^) TO BUILD 

GROOVE CHANGES THAT 
START AT GROOVE C AND 
END AT GROOVE C. 
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I 
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END ^ 
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START ^ 

GET THE FIRST SigiPost 
MARKER FROM THE TEMPLATE. 




CALCULATE THE NEW GROOVE 
VALUE: 

GROOVE = ((endGroove. 
startGioove)*('nMESo 

FAR)) /TOTAL TIME. 



142 



6CTTHEN£)(TSignPost 

MARK€R FROM THE iImPUTE. 




DECREMENT 
GROOV£. 



INCREMENT 
-GflOOVC. 



140-^ 


YES 


RANDOML' 
BETWEEN Th 
OPPORTUNITlEi 
DECREASE. OR 
THES 


Y CHOOSE 

1ree equal 
s to increase, 
ke€p groove 
;ame. 



FIG. 8 



(JND) 



8NS00CID; <WO_e6*4<22Ai.L> 



wo 96^4422 



PCTA}S96«1S17 



Class Personality { 
public: 

ChordEntry* 

SignPosf 



ChofdPalette 



m_pchordlist; 
niJ>sianpostlist; 
m_scalepattem; 
m.chordpalette; 



// List of all chords in chord connection graph. 
// List of all available sign posts. 
// Bit pattern definition of scale. 
// Palette of Chords for two octaves. 



class ChordPatette { 

public: 



}: 



ChordSelection m_palette[24J; // Two octave set of chords. 



dass SignPost { 
public: 

SignPost' 

ChordSelection 

ChordSelection 

DWORD 

): 



mj)next: 
m.chord; 
m_cadence[2]; 
m_signposts; 



//Linked list of sign posts. 

//Chord for signpost 

//Two chords for cadence. 

// Which signpost markers supported. 



Flia WB 



class ChordSelection { 

public: 

ChordSelection* mj)neKt; 

long m_chordpattem; 

long m.scalepattern; 

char m_root; 

short m_measure; 

char m beat; 

): 



//Linked list of chords (for Section use.) 

// Bit pattern that defines chord. 

// Bit pattern for underlying scale. 

//Root note of chord. 

// What measure (if in chord progression.) 

// What beat this falls on (in progression.) 
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dassChordEntiyf 

public: 
ChordEntry* 
NextChord* 
ChordSelection 
unsigned long 

)• 



m^pnext; 
m_pnextchordiist; 
m_chord; 
m.dwflags; 



II m dwflags: 
Idefine CE.START2 
«defineCE END 4 



class NextChord { 

public: 
NextChord* 
unsigned long 
ChoidEntry* 
int 
in! 
int 

}: 



mj)next: 

m.dwflags; 

m j}nextchord; 

m.nweiaht: 

m.nminDeals; 

m.nmaxbeats; 



//Next in Pefsonafity's list of ChoidEntrys. 
// Used to manage^etof next possible chords. 
//This chord. 
//Flags (see below.) 



// Chord to start a progression. 
//Chord to end a progression. 



//Linked list of these. 

// Flags <see below.) 

// Destination chord this points to. 

// Irnportance of destination chord (0 to 100.) 

// Min -beats to wait till chord. 

// Max beats to wait till chord. 



// m.dwflags carries a set of flags used in the process of walking the tree. 
#define NC.PATH 2 //For walking the tree. 

#define NC.NOPATH 4 //FaHed tree walk. 



FIG. 10D 
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(^START^ 



160 



CALLAssnnSignPostsOTO 

GIVE £ACjfSp>OSt MARKER 
IWTHETEMPUTEACHORD. 



162 



GET FIRST PAIR OF 
[CHORDS. 




160 



COMBINE ALL CHORD 
CONNECTION LISTS INTO 
ONE CHORD PROGRESSION 



168 



182 



REPLACE ENDING CHORD 
WITH FIRST CADENCE CHORD 
OF ENDING SIGN POST. 



COPY CHORD CONNECTION 
UST INTO SECTION. 



BUILD CHORD CONNECTION 
BETWEEN STARTING AND 
ENDING CHORDS BY CALLING 




r 



164 



SCAN THE TEMPLATES 
COMMAND UST AND COPY AU 
GROOVE AND EMBELLISHMENT 
COMMANDS INTO THE 
SECTIONS COMMAND UST 



172 



ADD SECOND CADENCE CHORD 
AND SIGN POST CHORD TO 
CHORD CONNECTION UST 



ADJUST CHORD TIMING. [ 



176 



GET NEXT SIGN POST PAIR 
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dass Section { 
public: 
Style 

Personality 

ChordSelection* 

Command* 

MIDISequence* 

int 

int 

int 

}: 



mj)style; 

m_ppersonality; 

mj)cboRjlist; 

mj)commandlist; 

mj)eventlist; 

m.nmeasuies; 

m.ntempo; 

m.nroot; 



//Style to peifonn. 

// Peisonalify defines scale, chords. 

// Chord progiession for Section. 

//Grooves and Embellishments. 

// Unked list of timestamped MIDI events. 

//jjength, in measuies. 

// Tempo, in tenths of Beats Per Minute. 

// Root of key signature. 



FIG. 12 







SELECT 1st SIGN POST 
MARKER FROM TEMPLATE. 






SCAN SIGN POST LIST IN 
PERSONALrrV, FIND ALL SIGN 
POST CHORDS THAT MATCH * 

Signpost marker. 







randomly CHOOSE ONE 
SK3NP0ST CHORD FROM ALL 
THAT MATCH. 



196 



ASSIGN SIGN POST CHORD 
TOMAflKER. 



202 



LOOK FOR PREVIOUS USE OF 
SAME SIGN POST IN 
TEMPLATE 




204 



YES 



r 



-206 



COPY PREVIOUS SIGN 
POSTTOMAfll«RS. 



r 



GET NEXT SIGN POST 
MARKER FROM TEMPLATE 
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220 



START ^ 



2I 



SET SEARCH PARAMETERS: 
BEATS s (END MEASURE- 
BEGIN MEASURE) 'BEATS PER 
MEASURE 
MAX CHORDS s BEATS » 
ACTIVITY 
CHORDS s MAX CHORDS^ 



222 



FIND PREVIOUS CHORD 
CONNECTION PATH THAT 
STARTED WITH SAME 
SIGNPOST. 



224 



21 



SET TOTAL TRIES 
COUNTER TO 4. 



242 



2\ 



DECREMENT TOTAL 
TRIES COUNTER. 



246 




248 



ADJUST MIN CHORDS AND 
BEATS TO ALLOW BEHER 
^HANCE OF SUCCESS. 

I 



BUILD CHORD CONNECTION 
USING END SIGN POST 
CADENCE CHORDS. 



w/w 



226' 



TREVIOUS^iXii 
PATH 

226 

NO 



232 



SCANFORRRSTCholdEniWlN 
PERSONAUTY THAT MATCHES 
STARTING SignPost CHORD. 




236 



CAUWalkTieeo 
WITH THE Ch ofdEnify. 



238 



240 




SCAN FOR NEXT ChoidEntiy IN 

PERSONAUTY THAT MATCHES 
STARTING SignPoSi CHORD. 



2l 



CAUWalhTreeo WITH THE 

PREVIOUS PATH (IT POINTS 

TOTHERRSTChotdEnliy.) 



230 




END ^ 
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MAflK ChoidEntiyTO 

SHOW THIS IS A 
GOOD PATH 

I 

(^RETURN true) 



CLEAfI PREVIOUS CHORD 
PATH {STOP PRIOR PATH 
IN THIS SEARCH 



272 



RANDOMLY CHOOSE NEXT 
ChOldEntfyfROMfiEMAINING 
NeXtChORf LINKS, WITH ODDS 

SETevNexlChoid WEIGHT. 



276 




TOUNDAXNO 

^ChordEntry^ 

? 



CALL THIS ROUTWE WITH 

THE ChofdEnbyfROM 

THE NextChoid LINK. 



280 




'RETURNffi^}^ 
JRUE?. 



MAflK NexiChoid 

I LINK AS NO GOOD. 



JK 

(return -FALSE^ 



FIG. 15 



wo 9^4422 



PCr/US96/01S17 



12/15 
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€0 
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o 

CO 



1-^ 
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t/5~*DC2 
DC^ oo 

y oc w 
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GET THE FIRST CHORD 
FROM THE SECTION. 



402 



404 




NO /NEW 
CHORD 

? 



READ THE ROOT VALUE OF THE 
CHORD. SUBTRACT THE 
SECTIONS SCALE ROOT. 



406- 



408 



trackXno 

.SCALE. 
[YES 



USE THE 0RK3INAL 
PERSONALITY'S SCALE TO 
CONVERT THE ROOT VALUE TO A 
SCALE VALUE PLUS ACCIDENTAL. 



410 



USE THE NEW PERSONALITY'S 
SCALE TO CONVERT THE SCALE 
VALUE PLUS ACCIDENTAL BACK 
TO A ROOT VALUE. 

1 



■412 



READ THE CHC 
PERSONAUTY 
ARRAY AT Tl 
DESCRIBED i 


)RD FROM THE 

s ChordPalette 

^E POSITION 
3Y THE ROOT 


> 




ADD THE SECTIONS SCALE 
ROOT TO THE CHORD ROOT. 






SCAN TO THE NEXT 
CHORD IN THE SECTION. 



1 



FIG. 17 



OCTAVE 


CHORD PQSmON 


SCALE POSITION 


OUT-OF-SCALE 
POSITION 
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500 
YES 



502 



504 
YES 



506 



TIMESHIFT s NEXT CLICK TIME 
•CURRENT TIME. 



508 



.YES 


TIMESHIFT s NEXT BEAT TIME 






-CURRENT TIME. 


3 



510 



TIMESHIFT = NEXT MEASURE 
TIME -CURRENT TIME. 



TIMESHIFT sO. 



512 



■514 



ADD TIMESHIFT TO MOTIF 
PERFORMANCE TIME. 


1 ^ 




GIVE MOT 
PERFORMAft 


IF TO THE 
ICE ENGINE. 



Q END ^ 



578 



BNSOCXID. «WO 9e5««a*;_i. » 



MilEiBlliiEII) 



wo 1^04422 



PCr/US9fi«lS17 



75/75 




SIIBSIinnESBSr(iHII£2S) 



INTERNATIONAL SEARCH REPORT 



Interrutiona] application No. 
PCT/US96/015I7 



I A. CLASSinCATION OF SUBJECT MATTER 
IPC(6) :A63H 5/00: G04B 13/00: GIOH 7/00 
US CL : 84/609 

I Accordmg to I niriaationa; Paieni CUsiification (IPC) or to both national classiftcation and IPC 
I B. iTELDS SEARCHED 

I Minimum documentation searched (cUssificaiion system foUowed by cUssification symbols) 
U.S, : 84/600. 609.610. 6J3 , 634 . 637, 649 



Documenuiion searched other than minimum documentation lo the extent that such documenu are included 



in the fields searched 



Electronic dau base consulted durmg die imemationaJ search (name of dau base and. where 



practicable, search terms used) 



|C DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citttion of document, with imiication. where appropriate, of the reievam passages 



US, A. 5,315,057 (LAND ET AL) 24 May 1994 

See col. 8, lines 29-52, col. 26, line 26 - col. 27, line 13 

col. 27, line 32 - col. 28, line 38. 



1 1 I ^I'^cr documents are listed in the 



cominuation 



"A" 

•f 
•o- 



special citcforio or cned 

documaii dcftntni ihc Bcocnl wu of tfic an wHich n not coniMcrad 
to toe of pincutor idrvmcc "wwcrao 



of Box C. n Set 



Relevant lo claim No. 



1,22,31,40 



patent family annea. 



cirlict documcn putotntM on ot aficf ihr 



fillQI I 



•X- 



Uiet Oocumcm published ifw r the imetiiMnttal filim djie or ptioniy 
Owe sad ooi la conflKi wuh ihc applicuionbiit ciM lo tiMtcrauM die 
pnacipk or theory unoerlymi iht mvcnuon 

tfonanni of lufucuui relevance: the cUtmcd tfivcmion cunoi be 



Oociflncia wttKii may throw Ooubu on piioniy claoMi) or whkh h 
ciiod 10 cnabtuh the publication date of iiiiiierr 
^lectal rcaioa i u apesifiod) 

document rcfrrnns to tn oral tfiactoaure 

means 

documeni pubitahed prior lo the mien 
the pnorny date ciaaned 



I filing c 



I Date of the actual completion of the imemaiional search 

14 APRIL ]996 

Name and mailing address of the ISA/US 
Comnuuioner of Patenu and Trademarks 
Box PCT 

Waihiasian. D.C. 20331 

Facsimile No. r703^ 305-3230 

Form PCT/lSA/210 <second shcetKJuly l992)o 

BNSOOCID < WO «6r«42SA I, I. > 



d novel or cannot oc conudercd to involve an invaunc atco 
•torn dtt deasncm b labcn alone 

■V docttmcM of particular relevance: the clamd mvenuon caaaot be 

comidered to involve an inventive «cp iwhcn the documeni u 
<mintd with oae or more other luch documcntt. inch combinauoo 
being obvwut to a perion ikilled m die an 

'4' doomera member of the aanw paicni family 

Date of mailing of the international search repon 



20 MAY 1996 



Authorized officer 

JEFF DONELS 
Telephone No. a03) 3Q«,i7fi? 



